Solves several key problems:
…In the beginning of the year 1666…I procured me a Triangular glass-Prisme, to try therewith the celebrated Phaenomena of Colours. And in order thereto having darkened my chamber, and made a small hole in my window-shuts, to let in a convenient quantity of the Suns light, I placed my Prisme at his entrance, that it might be thereby refracted to the opposite wall. It was at first a very pleasing divertisement, to view the vivid and intense colours produced thereby
Garijo et al; 2013 (Phil Bourne’s lab, NIH Data Science Director)
https://storify.com/hlapp/reproducibility-repeatability-bigthink
.@weecology @cboettig @LorenaABarba The @NESCent informatics team takeaway today: even reproduction-ready papers are hard to reproduce.
— Todd Vision (@tjvision) February 18, 2014
30% of results using STRUCTURE not reproduced, even when data and code were avialable: https://doi.org/10.1111/j.1365-294X.2012.05754.x
debian:stable, CRAN snapshotsStodden (IASSIST 2010) sampled American academics registered at the Machine Learning conference NIPS (134 responses from 593 requests (23%). Red = communitarian norms, Blue = private incentives
Stodden (IASSIST 2010) sampled American academics registered at the Machine Learning conference NIPS (134 responses from 593 requests (23%). Red = communitarian norms, Blue = private incentives
https://ropensci.org/blog/2014/06/09/reproducibility/
issues such as taxonomic standardisation remain a real stumbling block for ecological data reuse.
working with blocks of ugly data-wrangling code, or with long-running calculations, remains a challenge.
Check.
cache invalidation?
Check.
software still a moving target